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TITLE 

METHOD AND SYSTEM FOR PROCESSING MULTIMEDIA DATA 
BACKGROUND OF THE INVENTION 

Field of the Invention 

5 The present invention relates to a method and system 

for data processing, and in particular to a method and 

system for processing multimedia data. 

Description of the Related Art 

Multimedia data is often processed in Internet 
10 applications be embedded video and audio streams in web 

pages, with text or images as needed, for transmission. 

Interactive multimedia applications may also be used. 

Conventional methods are often limited by poor 

synchronization and integration between multimedia 
15 streaming objects and web elements, in which the 

multimedia streaming objects only can be created by web 

programs and executed in designated players. 

Conventional technology is thus unable to provide 

real-time interaction with users. 

2 0 SUMMARY OF THE INVENTION 

Accordingly, an object of the present invention is 
to provide a system for processing multimedia data, 
integrating MPEG-4 standard players and enabling better 
synchronization and integration of multimedia video 
25 stream, text, and images. 
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Another object of the invention is to provide a 
method for processing multimedia data, providing access 
of streaming data of all types through a web service. 

According to the object described, the present 
invention provides a system for processing multimedia 
data, comprising a digital content player, including an 
MPEG-4 system player and a data processing module, and a 
digital content server, including an access interface 
module, a video streaming encoder, and an MPEG-4 
streaming server. 

The digital content player streams multimedia data 
and displays images and text. The MPEG-4 system player 
receives and plays multimedia data in MPEG-4 format and 
executes user operations. The data processing module 
accesses remote real text data, in which Uniform Resource 
Locator (URL) information is embedded by prototype 
definition, through Simple Object Access Protocol (SOAP) 
and converts the data to images and text for display by 
the digital content player. 

The digital content server delivers multimedia data 
to a remote program, comprising an access interface 
module acting as an interface for real text data, video 
streaming encoder, merging and encoding text and 
multimedia data, and an MPEG-4 streaming server. In 
addition, the remote program, such as a data processing 
module, accesses multimedia data stored in a text 
database using the access interface module from the 
Internet via SOAP, in which the text database comprises 
text data. 
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The video streaming encoder merges text data stored 
in the text database and multimedia data stored in the 
■ multimedia database according to content templates stored 
in a content template database, such as MPEG-4 streaming 
5 data, transferring the data to the MPEG-4 streaming 
server. The multimedia database comprises raw video, 
image, and audio data. The content template database 
stores content templates referenced for merging 
multimedia and text data. The MPEG-4 streaming server 
10 transfers the MPEG-4 streaming data to the digital 
content player through Real-Time Streaming Protocol 
(RTSP) or Real-Time Transport Protocol (RTP) . 

The present invention further provides a method for 
processing interactive multimedia data. A digital 

15 content player connects to a digital content server 
through RTSP in accordance with URL information, embedded 
in text data by prototype definition. Next, the digital 
content player accesses and plays multimedia data from 
the digital content server using RTSP. Finally, remote 
20 text data is accessed using SOAP in accordance with the 
URL information when the digital content player acceses 
the text data . 

A detailed description is given in the following 
embodiments with reference to the accompanying drawings. 

2 5 BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention can be more fully understood 
by reading the subsequent detailed description and 
examples with references made to the accompanying 
drawings , wherein : 
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FIG. 1 is a schematic diagram showing the 
architecture of the system for processing multimedia data 
according to the present invention; 

FIG. 2 is a schematic diagram showing URL 
5 information embedded in text data according to the 
present invention; 

FIG. 3 is a schematic diagram showing real text data 
defined by prototype definition of the present invention; 

FIG. 4 is a flowchart of the method for processing 
10 multimedia streaming data using the digital content 
player of the present invention; 

FIG. 5 is a flowchart of the method for accessing 
remote text data using the access interface module of the 
present invent ion ; 
15 FIG. 6 is a flowchart of the method for generating a 

multimedia file using the Video streaming encoder of 
present invent ion ; 

FIG. 7 is a flowchart of the method for processing 
multimedia streaming data using the MPEG-4 system player 
2 0 of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention discloses a method and system 
for processing multimedia data. The method integrates 
MPEG-4 streaming data and web elements, in which MPEG-4 
2 5 streaming data is represented by Binary Format for Scene 
(BIFS) . 

FIG. 1 is a schematic diagram showing the 
architecture of the system for processing multimedia data 
according to the present invention. 
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The architecture comprises a digital content player 
100, including an MPEG-4 system player 110 and a data 
processing module 130, and a digital content server 200, 
including an access interface module 210, a video 
5 streaming encoder 23 0, and an MPEG-4 streaming server 
250. 

Digital content player 100 plays multimedia 
streaming data and interacts with images and text . 

MPEG-4 system player 110 receives and executes 
10 multimedia data with MPEG-4 format and user operations. 

Data processing module 130 accesses remote text 
data, in which Uniform Resource Locator (URL) information 
is embedded by prototype definition, through SOAP and 
converts the data to images and text to be displayed by 
15 the digital content player 100. 

The digital content server 2 00 delivers the 
multimedia data to a remote program, comprising an access 
interface module 210 accessing the multimedia data, a 
video streaming encoder 23 0, merging and encoding text 
20 and multimedia data, and an MPEG-4 streaming server 250. 

The remote program, such as data processing module 
13 0, accesses multimedia data stored in a text database 
using access interface module 210 from the Internet via 
SOAP, in which the text database comprises text data 
25 Video streaming encoder 230 merges text data, stored 

in text database 350 and multimedia data stored in 
multimedia database 310 according to content templates, 
stored in a content template database 330, as MPEG-4 
streaming data, for transfer to MPEG-4 streaming server 
30 250. Multimedia database 310 comprises raw video, image, 
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and audio data. Content template database 33 0 stores 
content templates referenced for merging multimedia and 
text data. 

MPEG-4 streaming server 250 transfers the MPEG-4 
5 streaming data to digital content player 100 through 
Real-Time Streaming Protocol (RTSP) or Real-Time 
Transport Protocol (RTP) . 

The method of the invention enables MPEG-4 streaming 
data to be displayed with text data using standard MPEG-4 
10 system players through data packaging, by prototype 
definition with BIFS. The digital content server of the 
invention processes text data defined by recognizing 
prototype specific embedded in the text data. 

FIG. 2 is a schematic diagram showing URL 
15 information embedded in text data according to the 
present invention. As shown in FIG. 2, the underlined 
description r exposedField SFString 

remoteUrl "http : //140 . 92 . 71 . 1/" j is the specific 

information embedded in text data, defined by prototype 
20 definition. 

FIG. 3 is a schematic diagram showing real text data 
defined by prototype definition according to the present 
invention. As shown in FIG. 3, the underlined program 
codes enable "Chinese" to be displayed with multimedia 
25 data in a browser complying with MPEG-4 standards. In 
addition, digital content player 100 is associated with a 
remote website in accordance with URL 

r http: //140 . 92 . 71 . 1/ j relating to the term "Chinese" . 
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FIG. 4 is a flowchart of the method for processing 
multimedia streaming data using the digital content 
player of the present invention. 

In step Sll, the digital content player connects to 
5 the digital content server using RTSP in accordance with 
given or specified URL information. 

In step S12 , the digital content player retrieves 
and plays multimedia data using the video streaming 
encoder of the digital content server through RTSP. 
10 In step S13, it is determined whether text data is 

processed, and, if so, the process goes to step S14, and, 
if not, to step S15. 

In step S14, the data processing module of the 
digital content player accesses remote text data via SOAP 
15 according to the URL information embedded in the 
multimedia data. 

In step S15, it is determined whether the process 
has terminated, and, if so, the digital content player 
closes, and, if not, the process goes to step S12 to 
20 continue the process. 

FIG. 5 is a flowchart of the method for accessing 
remote text data using the access interface module of the 
present invention . 

In step S21, the access interface module awaits 
2 5 remote request from a remote program, such as the data 
processing module. 

In step S22, it is determined whether the request 
call for data access has been received, and, if so, the 
process goes to step S23, and, if not, to step S21. 
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In step S23, the access interface module receives 
data tables relating to the multimedia data, such as 
images and text data, from the text database. 

In step S24, the multimedia data relating to the 
5 data tables is transferred to a remote program via SOAP. 

In step S25, it is determined whether the process 
has terminated, and, if so, the access interface module 
closes, and, if not, the process goes to step S26. 

In step S26, it is determined whether the connection 
10 has interrupted, and, if so, the process goes to step 
S28, and, if not, to step S27. 

In step S2 7, it is determined whether the data has 
been transferred completely, and, if so, the process goes 
to step S2 8 , and, if not , to step S24 
15 In step S28, data table access is terminated and the 

process goes to step S21 to continue the process. 

FIG. 6 is a flowchart of the method for generating a 
multimedia file using the Video streaming encoder of 
present invention . 
20 In step S31, it is determined whether the input 

data, given by users or specified by other programs, is 
video streaming data. If so, the process goes to step 
S35, and, if not, the process goes to step S32, in which 
the input data is converted to multimedia video streaming 
25 data with MPEG-4 format. 

In step S33, the multimedia video streaming data is 
stored in a video buffer. 

In step S34, it is determined whether the encoder 
has terminated, and, if so, the video streaming encoder 
30 closes, and, if not, the process goes to step S32. 
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In step S35, multimedia and text data stored in the 
text database are retrieved from the multimedia and text 
databases if the input data is not video streaming data. 

In step S36, the multimedia and text data are 
5 encoded as MPEG-4 files in accordance with multimedia and 
text content templates stored in the content template 
database. The process is thus terminated. 

FIG. 7 is a flowchart of the method for processing 
multimedia streaming data using the MPEG-4 system player 
10 of the present invention. 

In step S41, the MPEG-4 system player awaits remote 
request from a remote program, such as the data 
processing module. 

In step S42, it is determined whether the request 
15 call for data access has been received, and, if so, the 
process goes to step S43, and, if not, to step S41. 

In step S43, the MPEG-4 system player opens 
multimedia files generated by the video streaming encoder 
or the video buffer. 
20 In step S44, the multimedia data is transferred to a 

remote program via SOAP. 

In step S45, it is determined whether the process 
has terminated, and, if so, the access interface module 
closes, and, if not, the process goes to step S46. 
25 In step S26, it is determined whether the connection 

has interrupted, and, if so, the process goes to step 
S48, and, if not, to step S47. 

In step S47, it is determined whether the data has 
been transferred completely, and, if so, the process goes 
30 to step S48, and, if not, to step S44 . 
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In step S48, data table access is terminated and the 
process goes to step S41 to continue the process. 

The method of the invention integrates MPEG-4 
standard players and enables improved synchronization and 
5 integration with multimedia streaming, text, and images. 

While the invention has been described by way of 
example and in terms of the preferred embodiments, it is 
to be understood that the invention is not limited to the 
disclosed embodiments. To the contrary, it is intended 
10 to cover various modifications and similar arrangements 
(as would be apparent to those skilled in the art) . 
Therefore, the scope of the appended claims should be 
accorded the broadest interpretation so as to encompass 
all such modifications and similar arrangements. 
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